Data management services of NorduGrid

نویسندگان

  • A. Wäänänen
  • Niels Bohr
چکیده

In common Grid installations, the services responsible for storing big data chunks, replication of those data and indexing their availability are usually completely decoupled. And the task of synchronizing data is passed to either userlevel tools or separate services (like spiders) which are subject to failure and usually cannot perform properly if one of the underlying services fails too. The NorduGrid Smart Storage Element (SSE) was designed to try to overcome those problems by combining the most desirable features into one service. It uses HTTPS/G for secure data transfer, Web Services (WS) for control (through the same HTTPS/G channel) and can provide information to indexing services used in middlewares based on the Globus Toolkit . At the moment, those include the Replica Catalog and the Replica Location Service. The modular internal design of the SSE and the power of C++ object oriented programming allows one to add support for other indexing services in an easy way. There are plans to complement the SSE with a Smart Indexing Service capable of resolving inconsistencies hence creating a robust distributed data management system.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The NorduGrid production Grid infrastructure, status and plans

NorduGrid offers reliable Grid services for academic users over an increasing set of computing & storage resources spanning through the Nordic countries Denmark, Finland, Norway and Sweden. A small group of scientists has already been using the NorduGrid as their daily computing utility. In the near future we expect a rapid growth both in the number of active users and available resources thank...

متن کامل

The NorduGrid Architecture and Middleware for Scientific Applications

The NorduGrid project operates a production Grid infrastructure in Scandinavia and Finland using own innovative middleware solutions. The resources range from small test clusters at academic institutions to large farms at several supercomputer centers, and are used for various scientific applications. This talk reviews the architecture and describes the Grid services, implemented via the NorduG...

متن کامل

Henrik Thostrup Jensen Jesper Ryge Leth Automatic Job Resubmission in the Nordugrid Middleware

SYNOPSIS: This report describes the development of a daemon for automatic resubmission of jobs in the Nordu-Grid Toolkit. The report starts by giving an introduction to grids, what they are, why they are useful, and how resource sharing is organized by creating virtual organizations. Hereafter the focus shifts to grid archi-tectures, where a general grid model is presented, along with examples ...

متن کامل

Building a Production Grid in Scandinavia

Academic researchers in the Nordic countries participate in many common projects that process large amounts of data. To function effectively, such collaborations need a grid computing infrastructure that works across a wide area and uses distributed resources efficiently. Initial evaluations of existing grid solutions, however, showed that they failed to meet this requirement. The Globus Toolki...

متن کامل

The NorduGrid: Building a Production Grid in Scandinavia

The aim of the NorduGrid project is to build and operate a production Grid infrastructure in Scandinavia and Finland. The innovative middleware solutions allowed to set up a working testbed, which connects dynamic set of computing resources by providing a uniform access to them. The resources range from small test clusters of academic institutions to large farms of various supercomputer centers...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004